Fast video multiplexing system

ABSTRACT

The invention provides a method and apparatus for processing video data signals to generate a time division multiplexed video signal which incorporates a maxima number of fields from successive selected video input signals. The invention provides dual video decoder channels associated synchronisation circuits for generating an early synchronisation signal. The early synchronisation signals are applied to control inputs of the video decoders to enable reading of their output earlier than would normally be possible, avoiding delays in the combining of successive fields of video information in the video TDM signal. The provision of dual channels avoids delays due to lack of synchronisation between the different video sources.

BACKGROUND OF THE INVENTION

This invention relates to a method of and apparatus for processing videodata signals, to combine a plurality of video data signals into amultiplexed signal.

Video time-division multiplexers (video TDM's) are known in which aplurality of input video data signals, typically from several videocameras, are combined into a single video data stream. This data streamcomprises interleaved time-sliced video data or “map shots” from each ofthe cameras or other video input sources. A typical time-slice or snapshot of a video TDM signal is one field of an input video data signal.Each snap shot or field is typically marked so that the multiplexedvideo data stream can be separated and reconstructed or decoded into itscomponent parts, which are the original separate input video datasignals. The use of video TDM's permits data from a plurality of videosources to be recorded or transmitted on a single medium by time sharingthe medium between the different sources, reducing the capital andoperating costs of the overall installation.

A disadvantage of known video TDM's is that the time divisionmultiplexed output, by its definition is non-continuous for any onevideo input source. This is because, for any one video input source,there will be periods of time (during which the remaining of theplurality of the video input sources each have a field inserted into themultiplexed video data signal) that no field or snap shot from thatparticular video source is inserted into the multiplexed signal. Theproblem is exacerbated in the case of non-synchronised video sources.

It is an object of the invention to minimise the amount of data which islost due to this phenomenon.

SUMMARY OF THE INVENTION

According to the invention a method of processing video signalscomprises:

(a) selecting one of a plurality of video input signals;

(b) applying the selected video input signal to an analog to digitalvideo decoder;

(c) deriving from the selected video input signal an earlysynchronisation signal corresponding to the start of a field of thesignal;

(d) applying the early synchronisation signal to a control input of thevideo decoder to enable an output of the video decoder;

(e) reading data from the enabled output corresponding to the firstavailable field of the selected video input signal;

(f) repeating steps (a) to (e) for further selected video input signals;and

(g) combining the data read from the enabled output of the video decoderin each step (e) to form a time division multiplexed video signal.

The steps (a) to (f) may be carried out simultaneously and independentlyfor successively selected input video signals, to allow successivefields of the time division multiplexed video signal to be combinedwithout delays caused by lack of synchronisation between the selectedvideo input signals.

The early synchronisation signal is preferably derived from the selectedvideo input signal by independently extracting vertical synchronisationinformation from the signal while the signal is undergoing analog todigital conversion.

Preferably, the time division multiplexed video signal data read fromthe output of the video decoder is encoded by a digital to analog videoencoder for storage or transmission in analog form.

Further according to the invention apparatus for processing videosignals comprises:

switch means for selecting any one of a plurality of video inputsignals;

an analog to digital video decoder connected to an output of the switchmeans;

a synchronisation circuit associated with the video decoder forgenerating an early synchronisation signal from a selected video inputsignal corresponding to the start of a field of the signal and forapplying the early synchronisation signal to a control input of thevideo decoder to enable an output thereof;

storage means connected to the output of the video decoder for storingdata therefrom corresponding to the first available field of theselected video input signal; and

encoder means for combining data from the storage means corresponding tosuccessive fields of selected video input signals into a time divisionmultiplexed video signal.

The synchronisation circuit may comprise a video sync separator arrangedto extract vertical synchronisation information from the video inputsignal independently while the signal is undergoing analog to digitalconversion.

The synchronisation circuit preferably further includes timer meansarranged to generate an early vertical synchronisation signal derivedfrom a composite sync signal output of the video sync separator.

The storage means may comprise at least one random access memoryarranged to store data corresponding to a single field of video data.

The invention extends to apparatus for processing a plurality ofunsynchronised video signals comprising the above defined apparatusarranged in dual channels and including control means for selectingdifferent video sources for each of the channels, and for combiningstored data from the respective channels corresponding to successivefields of the different video sources.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagrammatic illustration of the output of a prior art TDMsystem;

FIG. 2 is a similar diagram to that of FIG. 1, showing the output of avideo TDM system according to the invention;

FIGS. 3 and 3A are a simplified block schematic diagram of video TDMapparatus according to the invention; and

FIGS. 4, 4A-4L, 5, 5A-5K, 6, and 6A-6J are schematic circuit diagramsillustrating the circuitry of FIGS. 3 and 3A in greater detail.

DESCRIPTION OF AN EMBODIMENT

In a conventional TDM system there is some delay in switching betweenthe outputs of respective video data sources A, B and C. Such systemcope with the delay by repeating fields from each source while waitingto switch to the next source. For example, in FIG. 1, field 1 fromsource A is repeated before a switch can be made to source B, and so on.This reduces the mount of useful data carried by the system. Due to thetypically asynchronous nature of different video sources, a finite timeis required for synchronisation during the switching from one inputvideo source to the start of a field from the next video source. Thisproblem can be addressed by the synchronisation and phase-locking of thedifferent input video sources. However, this is generally not practicaland is costly, as it requires that the synchronising signals be passedbetween the different sources. Apart from this, the cost of providingvery fast switches to switch between successive video sources isrelatively high.

The present invention addresses the problem of switching rapidly betweena plurality of unsynchronised video sources in a more economical way,and ensures that the video TDM will update each input video source atthe maximum possible rate. This is achieved by providing, in addition toa conventional video decoder IC, a separate video sync separator coupledwith timers for counting video sync lines, to generate a valid “goodvideo” signal without the need for a delay of one field duration afterswitching. This separate synchronisation circuit generates fast verticalsynchronising signals and is enhanced to provide early detection ofvertical sync. Dual decoder channels incorporating the above featuresare used to ensure that the presence of non-synchronous input videosources does not result in duplication of fields in the multiplexedvideo signal, increasing the number of different fields transmitted fromeach video source, as shown in FIG. 2.

A simplified block schematic diagram of the apparatus of the invention,shoving the dual channels, is shown in FIG. 3. The circuitry of eachchannel is shown in detail in FIGS. 4 to 5.

In the illustrated embodiment, eight industry standard NTSC or PAL videosources can be selected one at a time via an arrangement of industrystandard analog switches 10. (The video inputs are typically colourvideo sources but may optionally include some monochrome inputs. Forpurposes of this example, a typical signal from a colour video sourcewill be discussed.) The selected analog video is supplied via an output12 (in FIG. 4) to the decoder circuit in FIG. 5.

After the 8:1 analog switch circuit 10, the selected video source signalsplits into two paths and undergoes two separate parallel processes.

In the first path, the normal action of a commercially available videodecoder IC is utilised. The video signal passes via an anti-aliasingfilter 14 into the decoder IC 16. The anti-aliasing filter should have asharp roll-off at about 6.24 Mhz. The filter configuration shown in FIG.5 achieves the required roll-off relatively economically. The decoder IC15 is a readily available NTSC/PAL to YCrCb Decoder such as the BT812manufactured by Brooktree Corporation of San Diego, Calif. The setup andsupporting circuitry for the BT812 is in accordance with the Brooktreepublication L812001, Rev E or later. The digital output 18 of the BT812is 4:2:2, YUV digital representation of one field of the analog videoinput at the output 12 of the analog switch circuit 10.

In the second path from the output 12, the video signal passes through alow pass filter and buffer which is recommended but not essential, andwhich conditions the signal for a synchronisation circuit 20 based on anLM1881 sync separator IC. The LM1881 is the preferred sync separator inthis application and is manufactured by National Semiconductor. Thecomposite sync output from the LM1881 is fed to monostable timers 22 and24, to generate a fast vertical synchronising signal and to provideearly detection of the vertical sync, as follows.

The first monostable 22 receives the composite sync signal extractedfrom the sync separator as its input. The period of the first monostable22 is set to approximately 43uS, which is 67% of the time taken for onevideo line, and it will therefore generate at its output a negativepulse, starting about two thirds of the way through a normal lengthvideo line. During the vertical sync (VSYNC) half-line serrations,however, this monostable will be retriggered before it can time out, andthus its output will stay high.

The second monostable 24 has its delay set to 150% of the time taken fora video line, about 96 uS. As a result the monostable 24 will be resetby the above negative pulses from the monostable 22, but will time outduring the VSYNC period, giving an early VSYNC signal compared to thatwhich will be output by the LM1881 for the same input signal.

This valid early vertical sync signal is synchronised to the BT812decoder line sync output in the logic block 26, and the vertical syncsignal is used in a state machine as described below.

The flow of digital video information from the BT812 video decoder 16 toa memory circuit 28 is controlled with signals generated by a FiniteState Machine (FSM) residing in a suitable programmable logic device 30such as the MACH210.

The FSM implemented in the MACH210 is assisted by an external linecounter 32, typically a 74F161. The functions of the FSM can be brokeninto 3 main sections:

Validate: In this section the vertical sync of a new video source istested to see if it is at least 5 video lines wide. If true the FSMproceeds to the next section. If not true, it indicates a false or latevertical sync and the FSM then waits for the next vertical sync from thesame video source.

Vertical delay: This section is only executed once the “validate”section is successfully completed. The FSM starts the external counter32 and waits until the correct number of lines has been delayed, whichis to coincide with the start of active video on the digital outputlines 18 of the decoder 16.

Vertical mode: At this stage, the FSM enables writing to the memory 28via the logic block 26. Since all of the horizontal synchronisingsignals of the decoder 16 are fast locking, these signals me used togenerate horizontal timing signals to ensure that only video data fromthe active portion of each line is written into memory. If an alternatedecoder is selected with slower horizontal line synchronising, anexternal horizontal sync circuit with design logic similar to theinvention's logic for generating a fast vertical synchronising signalmay become necessary.

At the end of the field, upon detecting the presence of the verticalsync pulse, the FSM generates an interrupt to a controlling meanscircuit 34, which then switches the analog input switch 10 to anotherchannel, and forces the FSM back into the “validate” mode. Thiscompletes one normal cycle of the machine.

A logic block 36, consisting of registers and digital switchescontrolled by the FSM output, is used to pack data into the memory 28 ina suitable format, such as CCIR 656 compatible format.

The digital memory 28 can be one of many dual port memory types, such asfield memory or VRAM, and the choice depends on the intended applicationof the digital data and relative costs. For the video TDM application inthis example, a 2 Mbit field memory MSM51821-30ZS manufactured by OKISemiconductor was selected, and two field memories are used, 28a and28b. Since only one field of video data is stored at a time, the memorysize required for one channel of a dual decoder system to store onefield of chrome and luma information, with CCIR compatible 720 pixelhorizontal resolution, is 414 720 bytes. This is calculated as follows:

288 × (lines in 1 field of PAL video) 720 × (pixels in 1 line, of videodata) 2 (1 byte luma and 1 byte chroma per pixel) 414 720 bytes or 3 317760 bits

The FSM will only enable writing to memory while digital data from a newfield is being output from the decoder 16, and it will enable writingimmediately that a valid new field is output by the decoder. Itessentially replaces and improves the BT812 decoder's HACTIVE outputfrom this video TDM application, which cannot be reliably used as anEnable signal until more than one field from the new input video sourcehas begun image digitisation in the decoder.

The described system has a number of advantages over prior art systems.Each input video source will have at least twice as many new fields inthe multiplexer video data stream over any given time period as waspreviously achievable. This has the result that events of short durationare more likely to be captured in the data stream. This may be, forexample, important in multi-camera surveillance systems. Due to theincreased frequency of new fields in the decoded signal from any source,the signal will have a more lifelike and less jumpy appearance. Thesystem makes it possible to include one input video source in themultiplexed data stream at “real time” rates (the rate at which aconventional TV picture is updated) while still including other videoinput signals in the multiplexed output. This can be particularlyuseful, for example, if an unusual or alarm situation requires that oneparticular input video source be recorded or transmitted at maximum rate(normally the standard real-time TV field rate). In such a case, thesource of interest can be monitored without loss of information, whilestill allowing monitoring of the other input video sources.

The invention also makes it possible to record two unsynchronised inputcolour video sources in real-time on a single, unmodified, industrystandard VCR, with both inputs being recorded in real-time. Similarly,the invention makes it possible to transmit two input colour videosignals in real-time over a industry standard medium such as co-axialcable.

We claim:
 1. A method of processing video signals comprising: (a)selecting one of a plurality of video input signals; (b) applying theselected video input signal to an analog to digital video decoder; (c)deriving from the selected video input signal an early synchronisationsignal corresponding to the start of a field of the signal; (d) applyingthe early synchronisation signal to a control input of the video decoderto enable an output of the video decoder; (e) reading data from theenabled output corresponding to the first available field of theselected video input signal; (f) repeating steps (a) to (e) for furtherselected video input signals; and (g) combining the data read from theenabled output of the video decoder in each step (e) to form a timedivision multiplexed video signal.
 2. A method according to claim 1wherein steps (a) to (f) are carried out simultaneously andindependently for successively selected video input signals, to allowsuccessive fields of the time division multiplexed video signal to becombined without delays caused by lack of synchronisation between theselected video input signals.
 3. A method according to claim 1 whereinthe early synchronisation signal is derived from the selected videoinput signal by independently extracting vertical synchronisationinformation from the signal while the signal is undergoing analog todigital conversion.
 4. A method according to claim 1 wherein the timedivision multiplexed video signal data read from the output of the videodecoder is encoded by a digital to analog video encoder for storage ortransmission in analog form.
 5. Apparatus for processing video signalscomprising: switch means for selecting any one of a plurality of videoinput signals; an analog to digital video decoder connected to an outputof the switch means; a synchronisation circuit associated with the videodecoder for generating an early synchronisation signal from a selectedvideo input signal corresponding to the start of a field of the signaland for applying the early synchronisation signal to a control input ofthe video decoder to enable an output thereof; storage means connectedto the output of the video decoder for storing data therefromcorresponding to the first available field of the selected video inputsignal; and encoder means for combining data from the storage meanscorresponding to successive fields of selected video input signals intoa time division multiplexer video signal.
 6. Apparatus according toclaim 5 wherein the synchronisation circuit comprises a video syncseparator arranged to extract vertical synchronisation information fromthe video input signal independently while the signal is undergoinganalog to digital conversion.
 7. Apparatus according to claim 6 whereinthe synchronisation circuit further includes timer means arranged togenerate an early vertical synchronisation signal derived from acomposite sync signal output of the video sync separator.
 8. Apparatusaccording to claim 5 wherein the storage means comprises at least onerandom access memory arranged to store data corresponding to a singlefield of video data.
 9. Apparatus for processing a plurality ofunsynchronised video signals comprising the apparatus of claim 5arranged in dual channels and including control means for selectingdifferent video sources for each of the channels, and for combiningstored data from the respective channels corresponding to successivefields of the different video sources.
 10. A method of processing videosignals comprising: (a) selecting one of a plurality of video inputsignals; (b) applying the selected video input signal to an analog todigital video decoder; (c) deriving from the selected video input signala synchronisation signal corresponding to the start of a field of thesignal; (d) applying the synchronisation signal to a control input ofthe video decoder to enable an output of the video decoder; (e) readingdata from the enabled output corresponding to the first available fieldof the selected video input signal; (f) repeating steps (a) to (e) forfurther selected video input signals; and (g) combining the data readfrom the enabled output of the video decoder in each step (e) to form atime division multiplexed video signal.
 11. A method according to claim10 wherein steps (a) to (f) are carried out simultaneously andindependently for successively selected video input signals, to allowsuccessive fields of the time division multiplexed video signal to becombined without delays caused by lack of synchronisation between theselected video input signals.
 12. A method according to claim 10 whereinthe synchronisation signal is derived from the selected video inputsignal by independently extracting vertical synchronisation informationfrom the signal while the signal is undergoing analog to digitalconversion.
 13. A method according to claim 10 wherein the time divisionmultiplexed video signal data read from the output of the video decoderis encoded by a digital to analog video encoder for storage ortransmission in analog form.
 14. Apparatus for processing video signalscomprising: a switch operative to select any one of a plurality of videoinput signals; an analog to digital video decoder connected to an outputof the switch; a synchronisation circuit associated with the videodecoder for generating a synchronisation signal from a selected videoinput signal corresponding to the start of a field of the signal and forapplying the synchronisation signal to a control input of the videodecoder to enable an output thereof; a storage device connected to theoutput of the video decoder for storing data therefrom corresponding tothe first available field of the selected video input signal; and anencoder operative to combine data from the storage device correspondingto successive fields of selected video input signals into a timedivision multiplexer video signal.
 15. Apparatus according to claim 14wherein the synchronisation circuit comprises a video sync separatorarranged to extract vertical synchronisation information from the videoinput signal independently while the signal is undergoing analog todigital conversion.
 16. Apparatus according to claim 15 wherein thesynchronisation circuit further includes a timer arranged to generate avertical synchronisation signal derived from a composite sync signaloutput of the video sync separator.
 17. Apparatus according to claim 14wherein the storage device comprises at least one random access memoryarranged to store data corresponding to a single field of video data.18. Apparatus for processing a plurality of unsynchronised video signalscomprising the apparatus of claim 14 arranged in dual channels andincluding a controller for selecting different video sources for each ofthe channels, and for combining stored data from the respective channelscorresponding to successive fields of the different video sources.